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ABSTRACT 

The goal of the Elementary Counseling Project is to 
assist pupils to function more effectively socially, academically, 
and personally in their social environment. Specifically, the project 
seeks to improve, the level of reading achievement as well as the 
personal and social behavior of selected pupils in the school 
setting. During the 1983-84 school year, 13 counselors carried out a 
variety of activities in 14 Chapter 1 eligible schools. The program 
was evaluated in terms of four specific objectives: (1) pupils who 
receive treatment will demonstrate a significant increase in reading 
achievement; (2) pupils who receive treatment will demonstrate 
improvement in classroom behavior; (3) a range of counseling services 
will be provided for pupils and the school community; and (4) at 
least two inservice sessions will be provided to program personnel. 
Data for evaluation were collected from five sources: Metropolitan 
Achievement Tests, Devereux Elementary School Behavior Rating Scale 
II, i pupil census, counselor activity logs, and inservice 
evaluations. (BW) 
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Program Description 

The Elementary Counseling Projeot began in the Columbus Publio Schools 
during the 1965-66 sohool year. The foous of the projeot today, muoh as in the 
past, is to help each pupil rooeive maximum benefits from their educational 
experience. 

The goal of the Elementary Counseling Project is to assist pupils to 
function more effectively sooially, academically, and personally in their 
sooial environment, Speaifioally, the counseling projeot seeks to improve the 
level of reading achievement as veil as the personal and sooial behavior of 
selected pupils in the school setting. 

To reach thin goal, the 1983-84 projeot employed 13 counselors (10 full 
time equivalents) who served 14 Chapter 1 eligible schools. The following 
schools were served during the 1983-84 projeot year. 

Avondale Cranbrook Highland Reeb 

Be ok Dana Linden Southwood 

Blnns East Linden Meadry Sullivan t 

Burroughs Heyl 

During the 1983-84 sohool year, eleaentrr* oounselors oarried out a variety 
of aotivities ai >d at improving reading achievement '*nd behavior of seleoted 
pupils. These activities were oarried out at m&ny levels (e.g., pupil, small 
group, classroom, school, oommunity). 



Evaluation Oblsotlva 

Objective 1 .Q Seleoted pupils who receive the minimum treatment program will 
demonstrate a significant inorease in reading achievement. The minimum 
treatment program is defined as the oounselor works with the pupil onoe on an 
individual basis or once in a small group and onoe in a olassroom setting 
during a two week period. 

Criterion 1.1 80* of the seleoted pupils who meet the treatment 

program oriterion will ezoeed their expeoted growth 
in reading achievement. Expeoted growth will be 
determined by dividing the pupil's pretest grade 
equivalent by the number of months the pupil has been 
in sohool and multiplying that quotient by the length 
of the treatment program in months. 
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Criterion 1.2 



The average growth in reading achievement for pupils 
who weet the treatment program orlterion will he 1.5 
KCE points for each aouth of ths treatment period. 



Objective £.0 Selected pupils who receive the minimum treatment program will 
demonstrate improvement in ulassrooa behavior* The minimum treatment period is 
defined as the counselor works with the pupil once on an individual basis or 
once in a smell group and onoe ia & classroom attting during a two-week period. 

Cri"*rion 2.1 80U of the selected pupils who receive the Minimum 

treatment program viXl show improvement in one or 
more of 14 areas of classroom behavior as determined 
by the 1* fautcrs of the Bevereux Eleuentary School 
Behavior Sat lag Seal* II (DESB II) * These factors 
are: Work Organization; Creative Initiative/Involve- 
ment; Positive Toward Teacher? Seed for Direction in 
Work; Socially Withdrawn; Failure Anxiety; 
Impatience; Irrelevant ThinMng/Talk; Blataing; 
Negative/Aggressive; Perseverance; ?eer Coer^ratien; 
Confusion; and Inattention. 

Objecti ve 3.0 To provide a range of counseling services for suplls and the 
school community. 



Criterion 3.1 



Evidence that elementary counselors provide 
individualized counseling sessions, small group 
instruction and large group counseling seaaiono for 
pupils in the school; conduct parent conferences, 
tbaoher/ataff conferences, and make heme visits; make 
referrals to community agencies and folio? vp such 
referrals; and make referrals to school special 
servioes staff (nurses, psychologists, et. al. ) 

Qbleetive 4. 0 To provide at least two inaervioe seasiona to program personal 
suoh that at least B0% of the inservlce participants will rata each session as 
valuable in providing information that will assist them in carrying out t-hoir 
program responsibilities. 



Evaluation Design 

The evaluation design for the elementary counseling project called for the 
oolleotlon of data in four areas: 

1. Standardized Achievement Test Information 

The Reading Survey Test, of The Metrop olitan Achievement Tests 
(MAT; Presoott, Balow, Hogan & Farr, 1978), was administered to 



9 

ERIC 



4 



i 



3 



determine the achievement of the first objective in regard to 
reading improvement. The pretest of the MAT was administered in 
October, 1983 and the posttest in May, 1984. The test form and 
levels used at each grade level were: 



2. Behavior Rating Scale Information 

DaA-^ r *cgux,.E3.cagn^ftr7 -Svhool Behavior, Rating Scale II (desb ii; 
Swift, 82) was administered to determine the achievement of the 
first <. motive in regard to pupil behavior. The DESB II was 
completed by the classroom teachers in October 19 83 and again in 
Mar 19M. 

The DESB II was designed for use by teachers in describing the 
overt, classroom behavior of elementary pupils. This scale 
provides a profile of 14 faetorially-determlned dimensions of overt 
behavior that experienced teachers have Judged as being related to 
classroom achievement. In addition, there exists sufficient 
research evidence to show that these 14 dimensions of behavior are 
related to olassroom achievement (Swift, 1982). Previous research 
has also established the finding that teaohers oan make reliable 
and valid ratings with the DESB II when they have the pupil to be 
ratod in olass for a few weeks (Swift, 1982). The following 
behavior clusters are measured by DESB XI: 

Work Organization : The behavior measured by this factor 
identifies the degree to whioh the ohild oarries out tasks 
and work assignments on his own in an orderly fashion, and 
completes that work on time. The factor oonsists of four 
items: 10, 36, 39, 45. 

Creative Inltiative/Involvament: The behavior measured by 
this factor is related to the quality of the ohild' s 
personal, active and positive involvement in the process of 
learning. It reflects the extent to whioh he interacts with 
others about ideas, and introduces his own personal 
experiences and oreations in a fashion which enriches the 
learning of other pupils. This factor oonsists of five 
items: 12, 16 , 24, 29 , 30. 

Poaltlva Toward Teacher : The behavior measured by this 
factor indioates the extent to whioh the pupil values the 
teacher positively and views his relationship with the 
teacher as warm and 'riendly. This factor oonsists of four 
items: 20, 31, 35, 49. 



ftrado 
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Form and Level 
JS Primer 
JS Primary 1 



Form and Level 
JS Primary 1 
JS Primary 2 
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MBfld for Dlrootlon In Work ; The behavior measured by this 
faotor indicate* the degree to whioh the pupil aota reliant 
upon others for guidance when confronted "ith academic 
work. The factor identifies the level of ability to make 
independent decisions, to hold opinions, and to take 
independent aotion without the support and dlreotion of 
others. This faotor oonsists of three Items: 42, 43, 48. 

Socially Withdrawn ; The behavior measured by this faotor 
identifies the pupil who not only does not participate in 
the activities of the classroom but avoids Involvement and 
oomaunloation with peers as well. This factor oonsists of 
four items: 11, 21, 40, 46. 

Failure Araietv ! The behavior measured by this faotor is 
the fear of failure and anxious concern with anticipated 
inability to meet the achievement demands of the teacher 
and/or school situation. Not limited to test situations, 
the anxiety about meeting expectations reveals itself 
direotly in the display of upset, orylng, oversensitivity or 
anger when the ohild has difficulty understanding what is to 
be done. This faotor oonsists of four items: 3, 7, 25, 50. 

Impatience : The behavior measured by this factor is aa 
inappropriate impulse by the pupil to surge forward in work 
without an adequate understanding of directions, and never 
thinking muoh about the quality of the educational produot. 
This faotor oonsists of four items: 1, 6, 17, 44. 

Irrelevant Thtnkliut/Te lkt The behavior measured by this 
factor refleots a kind of talk and way of responding that is 
irrelevant to and often intrusive upon class discussions and 
aotivities. The pupil may answer questions in class, but 
his answers often have nothing or little to do with the 
questions. This factor oonsists of four items: 2, 9» 19, 
22. 

Blaming; The behavior measured by this factor indicates the 
extent to whioh the pupil expresses the feeling that 
erternal ciroumstanoes (e.g., the teaoher, the work) are the 
souroes of his difficulties. This factor oonsists of four 
items: 4, 13, 18, 41. 

Negative- A ggrftgg l i Yf ; The behavior measured by this factor 
indicates the extent to whioh the pupil's behavior is 
aggressive and negative toward peers, property and the rules 
of the classroom. This factor oonsists of four items: 14, 
26, 27, 28. 

perseverance ! The behavior measured by this duster 
identifies the extent to which a pupil completes work even 
when extra effort is required, The duster oonsists of two 
items: 23, 33* 
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Peer Cooperation : The behavior measured by this cluster ia 
ooncerned with how a pupil rentes to and works with peers. 
The duster oonsists of two items: 32, 38* 

"onfuaion : The behavior measured by this cluster depiots 
the extent to which pupils have difficulty gaining the 
meaning of what is to be done or what is being disoussed. 
Thus they become oonfused about olass work and unable to 
prooeed on their own or answer questions. The duster 
oonsists of* three items: 5, 34, 43. 

TnattantloB i The behavior measured by this cluster 
indioates the degree to whioh the pupil pays attention to 
the teacher and orients his thinking and interaction around 
the oontent of classroom work. The duster oonsists of four 
iteus: 8, 15, 37, 47. 

3. Pupil Census Information 

The Pupil Census Form (PCP) was used to record descriptive data and 
data regarding the program treatment that pupils reoelved. 
Counselors oompleted a PCP for each pup.il in May 1984 (see Appendix 
A). 

4. Counselor Aotivity Log Information 

The Counselor Aotivity Log was used to obtain information regarding 
the counseling servioes provided and the targets of those 
services. Eaoh counselor was randomly assigned to oomplete the log 
for one week during the months of October 1983 through May 1984 
(see Appendix A). 

5. Inservioe Evaluation Information 

The General Inservioe Evaluation Form was completed by the 
oounselor at the dose of the inservioe sessions oonducted for the 
counselors during the 1983-84 school year (see Appendix A). This 
instrument was used to determine the number of sessions held and 
the ratings of the counselors regarding the value of the inservioe. 

Pupils in grades two and three who were referred by the olassroom teaohtrs 
beoause the pupils were one or more years below grade level as determined by 
the basal reading series; and the pupils were, in the judgment of the teaohers, 
exhibiting behavior problems in the classroom, met the seleotion oriteria for 
inolusion in the evaluation sample. From the list of pupils referred by the 
classroom teachers, pupils were randomly seleoted for project inclusion. 
Approximately 40 pupils were seleoted by each fdl-time equivalent oounselor. 

To be inoluded in the MAT and DESB II analyses, a pupil had to have a 
pretest and poattest soore on the respective instruments and have received at 
least 70| of the treatment program. The treatment program was defined as at 
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least one Individual counseling session or one small group counseling session, 
and one classroom counseling session for each pupil every two weeks during the 
tiae between the pretest and posttest. 

To determine if a significant increase occurred in reading achievement the 
expected rate of growth was computed for selected pupils who met the treatment 
program criterion. Expeoted growth was determined by dividing the pupil's 
pretest grade equivalent by the number of months the pupil had been in school 
and multiplying that quotient by the length of the treatment program in 
months. The types of scores utilized in the analysis were grade equivalents 
and normal curve equivalents (NCE's). NCE's give the truest picture of actual 
growth as opposed to percentiles and grade equivalents whioh are not equal 
units of measurement. NCE's are standard scores based upon percentiles, and 
are equal units of measurement along the normal distribution. In a normal 
distribution, the lowest possible NCE score is one and the higl est is 99 , with 
a mean of 50. At these three points only are NCE's and percentile soores the 
same. 

Several analyses of the DESB II data were carried out in order to determine 
if the school behaviors of sample pupils improved during the year. These 
analyses included a comparison of the means of the pre-treatment and 
post- treatment factor soores and an examination of the number and percentage of 
pupils Showing improvement. 



Ma lor Findings 

To determine if Objective 1.0 and 2.0 were achieved efforts were made to 
collect Metropolitan Achievement Test (MAT), Devereux Elementary School 
Behavior Rating Scale II (DESB II), and Pupil Census Form (PCF) data on the 
pupils selected for inclusion in the evaluation sample. PCF data were 
collected on 284 pupils. Matched pretest-posttest MAT data were collected for 
278 pupils. Of 277 pupils having matched pretest-posttest MAT and DESB II 
data, 50.91 (141) met the treatment program criterion and were inoluded in the 
analysis. To meet the treatment oriterion the pupil had to have a PCF that 
indicated that th, pupil received at least one individual counseling session or 
one small group session, and treatment in the classroom setting every two weeks 
during the time between the pretest and posttest. For purposes of MAT 
analysis, the 141 pupils in the sample were comprised of two groups. Group 1 
consisted of pupils who received the counseling treatment program and were 
served in an ECIA Chapter 1 compensatory reading program. Pupils in Group 2 
received only the counseling treatment program. Overall, the composition of 
the sample was: 89 (63. 1*) boys and 52 (36.05) girls; 72 (51.1$) minority 
pupils and 69 (48.9*) non-minority pupils; and 75 (53. 2%) second-graders, and 
66 (46.8$) third-graders. Tables 1 through 3 contain further information 
regarding the sample composition. 

To determine if sample pupils did have a significant increase in reading 
achievement, as stated in Objective 1.0, analyses of grade equivalents and NCE 
gain scores were done separately for Group 1 and Group 2. Results of these 
analyses are presented in Tables 4 through 6. 
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Table 1 

Number of Pupils by Sex and 
Ethnlo Group by Grade Level 



Minority Non-Hinorltv Xffi£aJL 

Ora da Bova Qlrla Total Bovs Girls Ififcal BfllS SiElS Total 

2 25 1H 39 27 9 36 5 2 23 7 5 

3 21 12 33 16 17 33 37 29 66 



Total 46 26 7 2 43 26 69 89 52 1 41 



Table 2 



Number of Pupils by Sex and 
Ethnio Group by Grade Level 
for Group 1 







Minority 




Mon-Mlnorltv 






Total 




Grada 


Bova 


Girla 


Total 


Bova 


Girla 


Total 


Bova 


Girla 


Total_ 


2 


17 


12 


29 


20 


6 


26 


37 


18 


55 


3 


14 


10 


24 


12 


16 


28 


26 


26 


52 


Total 


31 


22 


53 


3Z. 


22 


54 


63 


44 


107 



Table 3 



Number of Pupils by Sex and 
Ethnlo Group by Grade Level 
for Group 2 







Minority 




Hon-Minoritv 






Total 




Grade. ... 


Boys 


Girls 


Total 


Bova 


Girla 


Total 


Eovs 


Girls 


Total 


2 


8 


2 


10 


7 


3 


10 


15 


5 


20 


3 


7 


2 


9 


4 


1 


5 


11 


3 


14 


Total 


15 


4 


19 


11 


4 


15 


26 


8 


34 



9 

ERIC 



9 



8 



Criterion 1.1 of Objective 1.0 was not achieved. The data concerning the 
percent of pupil* exceeding the expected rate of growth in reading achievement 
is summarized in Table 4. These data indicate that 61.0% of all sample pupils 
exceeded the expected growth in achievement. Thus the 80? criterion was not 
met. The data indicated that Group 2 (the group receiving only counseling) had 
a smaller percentage of ga5^ than Group 1 (the group receiving both counseling 
and Chapter 1 assistant). In fact, only 20 of the 34 pupils in Group 2 
(58.8?) met or exceeded the expected growth in reading, whereas 66 of the 107 
pupils in Group 1 (61.7?) met or exceeded the expected growth in reading. The 
percentage of pupils who met or exceeded Criterion 1.1 at each grade level was 
57*3? at grade two, and 65.2? at grade three. 



Table 4 



Number and Percentage of Pupils Who Exceeded 
the Expected Rate of Growth Reported by 
Group Within Grade Level 









Pupils Who Exceeded Expected 


Grade 


Pupils 


Group 


Number 


Percent 


2 


55 


1 


31 


56.4 




20 


2 


12 


60.0 


Subtotal 


75 




43 


57.3 


3 


52 


1 


35 


67.3 




n 


2 


8 


57.1 


Subtotal 


66 




43 


65.2 


Total 


141 




86 


61.0 



Criterion 1.2 of Objective 1.0 was not achieved. The data concerning NCE 
gain scores are summarized In Table 5 by group within grade level. The data 
indicate that the average NCE change score for all sample pupils was 8.2, which 
failed to achieve the criterion NCE mean change score of 10.5, or 1.5 NCE for 
each month of the seven month period of treatment. 

Further analysis of the data contained in Table 5 Indicates that pupils in 
grade two failed to achieve the criterion, while those In grade three achieved 
the criterion. In Group 1, grade two pupils showed a gain of 5.7 NCE points, 
and grade three pupils showed a gain of 10.5 NCE points. In Group 2, grade two 
pupils showed a gain of 7.6 NCE points and grade three pupils showed a gain of 
10.6 NCE points. Group 1 pupils showed smaller NCE gains from pretest to 
posttest than Group 2 pupils. Although grade two pupils failed to achieve the 
criterion of 10.5 NCE growth set for them, progress in reading was nonetheless 
achieved, because the standard expected NCE change score for a pupil receiving 
no program treatment is zero. 
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Table 5 

Means and Standard Deviations of the Pretest 
and Posttest Normal Curve Equivalents (NCE) 
Reported by Group Within Grade Level 



Grade 


Pupils 


Group 


Mean 


Standard 


Mean 


Standard 


Mean 








NCE 


Deviation 


NCE 


Deviation 


Change 


2 


55 


1 


27.2 


13.9 


32.8 


18.4 


5.7 




20 


2 


32.9 


10.5 


40.4 


13.4 


7.6 


Subtotal 


75 




28.7 


13.2 


34.9 


17.4 


6.2 


3 


52 


1 


27.1 


14.7 


37.6 


14.4 


10.5 




14 


2 


35.0 


14.0 


45.6 


14.1 


10.6 


Subtotal 


66 




28.8 


14.8 


39.3 


14.6 


10.5 


Total 


1*1 




28.7 


13.9 


36.9 


16.3 


8.2 



An analysis not specif ioally called for in the evaluation design was done 
with the NOB data. To determine if sample pupils did have statistically 
significant growth in reading achievement, a .fc-teat of NCE scores was done 
separately for Group 1 and Group 2. Table i presents the results of this 
analysis. As indicated in the table, both groups did show statistically 
significant growth (jl <.001) in reading. 



Table 6 

Means, Standard Deviation, and Associated 
^-Values of the Pretest and Posttest 
Normal Curve Equivalents (NCE's) Score 



Poattoflt 
Standard 

Mean Deviation t-Values 

35.2 16.6 5.86» 

42.3 13.7 4.12« 



•ft <.001 



Pretest 

Standard 

Oroun Pupils Mean Deviation 

1 107 27.1 14.2 

2 34 33.7 11.9 
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To determine if improvement occurred in pupils 1 classroom behavior, as 
specified in Objective 2.0, pre-treatment ar i post- treatment DESB II factor 
scores were analyzed for the 141 pupils in ti*e evaluation sample. These factor 
scores were derived from teacher ratings of 50 items related to pupil behavior 
in the classroom setting. For nine of the factors a negative condition is 
indicated when the factor score is at least one standard deviation above the 
mean of the norm group. For the remaining five factors a negative condition is 
indicated when the factor score is at least one standard deviation below the 
mean of the norm group. Data concerning the mean factor scores for pupils in 
the evaluation sample, for both pre-treatment and post-treatment assessments, 
are summarized in Tables 7 and 8. 

An analysis of the data contained in Table 7 indicated that the mean factor 
scores of 11 factors showed some improvement by moving in a positive 
direction. The mean factor scores for three factors, Failure Anxiety, 
Irrelevant Thinkiag and Blaming, worsened from pre-treatment to post-treatment, 
but remained in a positive range for both assessments. One factor, 
Negative-Aggressive Behavior, improved slightly from the time of pre-treatment 
to that of post-treatment assessment, but remained in the negative range at 
both times. 

The 'data contained in Table 8 indicate for each behavior factor the number 
and percent of sample pupils who were assigned negative factor rankings in the 
pre-treatment assessment and moved to positive factor rankings in the 
post- treatment assessment. The behavior factor with the greatest percentage of 
pretest pupils in the negative range was Peer Cooperation, (58.2$), while the 
factor with the least percentage of pretest pupils in the negative range was 
Failure Anxiety (16.3$). The factor showing the greatest percentage gain of 
pupils moving from a pre-treatment negative range to a post-treatment positive 
range was Impatience (60.0$), while that factor showing the least percentage 
gain was Blaming (30.8$). The Negative- Aggressive behavior factor, which had 
mean factor scores in the negative range on both the pre-treatment and 
post- treatment rankings, also showed a small (31 • *»$) percentage of pupils 
moving from the pre-treatment negative range to the post-treatment positive 
range. On average, 48.5$ of the pupils with pre-treatment rankings in the 
negative range, moved into the positive range on the post-treatment rankings. 
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Table 7 

Pre-Treatment and Post-Treatment Means 
for DESB II Faotor Soores 

N * 141 



Pre-Treatment Poa t-Tre atmcjat 





Pupil 
Behavior 
Factors 


Mean 
Faotor 
Score 


Faotor Soores 
Whioh Indicate 
Negative 
Behavior 


Mean 
Faotor 
Score 


Factor 
Score 
Imorovement 


1. 


Work Organization 


11.5* 


(less than 12) 


12.9 


yes 


2. 


Creative Initiative/ 
Involvement 


'» V. f 


(9 or less) 


12.9 


yes 


3. 


Positive Toward Teacher 


12.8 


(12 or less) 


14.6 


yes 


4. 


Need for Dlreotion in Work 


12.9 


(13 or sore) 


11.5 


yes 


5. 


Sooially Withdrawn 


11.7 


(13 or more) 


10.4 


yes 


6. 


Failure Anxiety 


10.5 


(15 or more) 


10.7 


no 


7. 


Inpatienoe 


14.2 


(17 or more) 


13.7 


yes 


8. 


Irrelevant Thinking/ Talk 


9.9 


(12 or more) 


10.0 


no 


9. 


Blaming 


8.1 


(12 or more) 


8.9 


no 


10. 


Negative-Aggressive 


10.0* 


(9 or more) 


9.7 R 


yes 


11. 


Perse veranoe 


5.3 


(5 or less) 


6.0 


yes 


12. 


Peer Cooperation 


6.9 a 


(7 or less) 


7.8 


yes 


13. 


Confusion 


11.4 


(13 or more) 


10.0 


yes 


14. 


Inattention 


15.1 


(16 or more) 


13.8 


yes 



*ln negative range 
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Table 8 



Number and Percentage of Pupils Having Negative 
Pre- Treatment Soores and Positive Post-Treatment Soores 

M > 141 



Pupil 
Behavior 
Feotora 



1. Work Organization 68 

2. Creative Initiative/ 52 
Involvement 

3. Positive Toward Teacher 67 

4. Need for Direction in 61 
Work 

5. Sooially Withdrawn 48 

6. Failure Anxiety 23 

7. Impatienoe 40 

8. Irrelevant Thinking/Talk 44 

9. Blaming 26 

10. Negative- Aggressive* 70 

11. Perseverance 77 

12. Peer Cooperation 82 
13* Confusion 53 
14. Inattention 62 



Percentage 
Number of of Pupils 
Number of Percentage Pupils Moving Moving 
Pretest of Pretest from Pretest from Pretest 
Pupils in Pupils in Negative to Negative to 
Negative Negative Post test Post tent 

JKiQgl BaAgs Pofii.lYe Positive - 



48.2 
36.9 

fr.5 

43.3 

34.0 
16.3 
28.4 
31.2 
18.4 
49.6 
54.6 
58.2 
37.6 
44.0 



39 
29 

36 

27 

25 
12 
24 
20 
8 
22 
38 
37 
30 
28 



57.4 
55.8 

53.7 
44.3 

52.1 
52.2 
60.0 
45.5 
30.8 
31.4 
49.4 
45.1 
56.6 
45.2 



•Mean Faotor Score in negative range on both pretest and posttest 
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Additional analysis of the DESB II data revealed that of the 141 pupila 
having ooapleted pre-treatment and post- treatment' data, 133 (94.31) pupila had 
at least one pre-treatment soore in the negative range. Of the the 133 pupils, 
112 (84.21) had one or more of these soores in the positive range on the 
post- treatment ratings. Consequently, the DESB II data indicated that 
Objective 2.0 was achieved. 

In addition to th* services provided for the 141 pupils in the evaluation 
sample, elementary counselors provided services to another 137 pupils who were 
referred by classroom teachers, and had matched pretest and posttest MAT 
scores, but did not meet the program treatment criterion. Information 
regarding the services for each referred pupil was provided by counselors via 
the Pupil Census Form (PCP). The PCF indicated the type and frequency of 
servioes. 

A summary of the activities carried out by the counselors with referred 
pupils is presented in Table 9. Nearly all of the 278 pupils were provided wih 
some individual or small group counseling, with 245 (88.11) of the pupils 
having aix or more individual sessions, and 275 (98.91) of the pupils having 
six or more small group counseling sessions. The data also indicated that 270 
(97.1 ) of the pupils were provided with guidance in the olassroom group 
sessions. The counselors were also involved in some family counseling with 176 
(63.3$)' of the pupils. The counselor referred 24 (8.6J) of the pupils to 
social agenoies. Of this number 14 (58.31) were known to have received agency 
servioes. Overall, the data indicated that counselors employed individual, 
small and olassroom group guidance techniques in working with the referred 
pupils. 



Table 9 

Frequency of Counselor-Pupil Contaots 
hy Type of Servio* Provided 

M * 278 



Ttm» of Service 




Cfth«ffoi*i«a of Freauenov of Puoil Contaots 


Now 


1-5 


6-10 


11-15 


16 or More 


Individual Contaots 


3 


30 


57 


92 


96 


Small Group Sessions 


1 


2 


66 


71 


138 


Classroom 










48 


Group Sessions 


8 


107 


56 


59 


Family Counseling 


102 


158 


11 


7 


0 
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The third objeotive in the evaluation design stated that counselors would 
provide a range of counseling services to various target groups. The 
instrument used to oolleot data regarding this objeotive was the Counselor 
Aotivity Log. A Counselor Aotivity Log was oompleted for eaoh of the 14 
sohools served by counselors for one veek periods froa October 31 » 1983 to May 
18, 1981. A sumaary of the data froa the Counselor Aotivity Log appears in 
Appendix B. 

An interesting way of summarizing the data froa the Counselor Activity Logs 
is to look at what ooours during an "average" week of an eleaentary oounselor. 
During the average week the counselor conducted eight individualized counseling 
sessions, eaoh lasting approximately 20 minutes; provided six small group 
sessions, eaoh lasting approximately 30 ainutes; oonducted five large group or 
olassrooa sessions, eaoh lasting approximately 32 minutes; participated in four 
parent conferences and 12 teaoher or staff conferences; made one home visit; 
made one referral to a community agency; made two follow-ups of referrals to 
coaaunity agencies; Bade four referrals to school specialists, such as 
psychologists, nurses, etc.; and participated in various other activities suoh 
as organizing asseablies, oalling parents, supervising student council 
activities, or coordinating testing programs at the building. 

The evaluation data indicated the objeotive was achieved. The analysis of 
the data revealed counselors did provide a wide range of services, and worked 
at aany different levels, e.g., oommunity, school, and olassrooa. 

In order to deteraine .if Objeotive 4.0 was aohieved, counselors were 
requested to respond to a General Inservice Evaluation Fora at the close of 
each of four inservioe sessions. A summary of the responses made by oounselors 
to the evaluation survey is found in Table 10. The rating scale used for the 
four items was (1) Strongly Disagree, (2) Disagree, (3) Undecided, (4) Agree, 
and (5) Strongly Agree. 

Across the four sessions, inservice data were obtained from 72 
respondents. The data indioated 98.6$ agreed or strongly agreed that the 
meetings were worthwhile, 100.0* agreed or strongly agreed that the information 
presented would be of program assistance, 100.0$ agreed or strongly agreed that 
there was time to ask questions, and 98.6$ agreed or strongly agreed that 
questions were answered adequately. Therefore, Objeotive 4.0 was fully 
aohieved. 

Comments froa oounselors indicated that inforaation and aaterials, as well 
as discussions with presenters were the aost valuable parts of the aee tings 
provided. Counselors indicated that the least valuable parts of the 
presentations were inforaation that was already available or not geared to 
counselors' needs. For the most part, oounselors wanted more information 
oonoerning how to help students with speoial needs, aore inservice on the new 
reading series, guidance techniques, and learning styles. 
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Table 10 

Average Response and Percent of Responses 
For Reactions to Inservioe Statements 



Percent 



Statements 



Number Average SD 
Responding Response Ql 



D 0 A SA 
121 131 (V L51 



1. I think this was a very 
worthwhile meeting. 71 

2. The information presented 
in the meeting will assist 

me in my program. 71 

3. There was time to ask 
questions pertaining to 

the presentation. 72 

4. Questions were answered 
adequately. 72 



4.6 0.0 0.0 1.4 33.8 64.8 



4.7 0.0 0.0 0.0 33.8 66.2 



4.7 0.0 0.0 0.0 31.7 65.3 



4.6 0.0 0.0 1.4 34.7 63.9 



Hummm r» / Bmonmm * nda t ions 

The 1983-84 elementary counseling projeot had four objectives. First, 
selected pupils who received the minimum treatment program would demonstrate a 
significant increase in reading achievement. Criterion 1.1 stated that B0% of 
the selected pupils would exceed their expected growth in reading achievement; 
and Criterion 1.2 indicated that pupils would have an average growth of 1.5 
normal curve equivalent (NCB) points for eaoh month of the treatment program. 
Seoond, 80$ of the seleoted pupils who met the treatment program criterion 
would show improvement in one or more of the 14 areas of olassroom behavior as 
determined by the Devereux Elementary Sohool Behavior Rating Scale II (DEISB 
II). Third, counselors would provide a range of counseling servloes to various 
target groups, with evidence that such servloes were provided. Fourth, 
counselors would be provided at least two Inservioe sessions, and 80$ of the 
counselors at eaoh session would rate the inservioe as valuable in assisting 
them to carry out their program responsibilities. 



To determine if a significant increase in reading achievement did occur, 
matched pre test- post test Metropolitan Achievement Test (MAT) data were 
oolleotcd on 278 aeoond and third grade pupils. These pupils had been referred 
by the classroom teachers because they were one or more years below grade level 
in reading and were having behavior problems in the olassroom. Of the 278 
pupils, 141 (50.7$) met the program treatment criterion and oomprised the 
evaluation sample. For purposes of analysing the MAT reading achievement data, 
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the 1 HI pupil sample consisted of two groups Group 1 was comprised of pupils 
who received the counseling treatment and were served in a compensatory reading 
program. Group 2 received only the counseling treatment. 

The analyses of the MAT data showed that Objective 1.0 was not achieved. 
First, of the 111 sample pupils, 86 (61.09) had gains greater than expected. 
Thus, the 80S criterion was not met. Second, the average NCE growth was 8.2. 
Thus, the 10.5 criterion was met. In interpreting the NCE change data it 
should be kept in mind that the expected NCE growth for pupils receiving no 
treatment is zero. Pupils did show growth in reading. However, on average the 
sample pupils did not meet the ECIA Chapter 1 growth guideline of 1.5 NCE point 
for each month of treatment. Further analyses of the MAT pre test- post test data 
indicated that there was statistically significant NCE growth for pupils in the 
evaluation sample. 

To determine if improvement occurred in the area of social and personal 
behavior within the school environment, pre-treatmeut and post-treatment DESB 
II data were collected on pupils in the evaluation sample. The analyses of the 
DESB II data revealed that pupils did show improvement in 11 of 14 factors of 
school behavior measured by the DESB II. The data indicated that of the 141 
pupils having complete pre- treatment and post- treatment DESB II data, 133 
(94.39) pupils had at least one pre-treatment score in the negative range. Of 
the 133 pupils, 112 (84.29) had one or more of these scores in the positive 
range in the post-treatment ratings. The DESB II data indicated that Objective 
2.0 was achieved. 

In addition to the services provided the 141 pupils in the evaluation 
sample t elementary counselors provided services to 137 additional pupils who 
were referred by classroom teachers, but did not meet the program treatment 
criterion. Information regarding the services provided each referred pupil was 
reported on the Pupil Census Form (PCF). The PCF data for pupils with both 
pretest and posttest soores (278) indicated that (245) 88.19 were provided with 
six or more individual sessions and (275) 98.99 were provided with six or more 
small group counseling sessions. The data also indicated that ^70 (97*19) of 
the pupils were provided with guidance in the classroom setting. The data 
revealed that counselors tended to employ individual, small group and classroom 
guidance techniques in working with pupils. 

To determine if counselors did provide a range of counseling services to 
various target groups, the Counselor Activity Log was maintained. Each 
counselor completed a log for a ons week period during the project. The 
Counselor Activity Log data indioated that the third objective was achieved. 
Evaluation data revealed that elementary counselors provided a wide range of 
services to pupils and building personnel and worked at many different levels 
(e.g., community, school, olassroom). 

Inservioe data indicated that the fourth project objective was aohieved. 
Counselors responded favorably to the meetings prov.' led for them and 
perceived: (a) the meetings were worthwhile; (b) information presented was of 
benefit; (o) there was adequate time to ask questions; and (d) that questions 
were answered adequately. 
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The analyses of the evalu . ten data and information gathered informally 
through the oourse of oonduotiiig the evaluation of the projeot served as the 
basis for recommending that: 

1. If direot reading Improvement services oontinues to be a 
responsibility of the projeot, counselors should direct more of 
their efforts to second grade pupils, and particularly those pupils 
referred to them who are also being served by other compensatory 
reading programs. These pupils scored lower than other sample 
pupils. 

2. Although counselors are assigned a wide range of activities by 
their principals, the primary foous of their efforts should be to 
effectively work on projeot activities which inolude direot 
servioes to pupils and building level counseling activities. 

3. If the projeot is to be funded by the General Fund in the oomlng 
sohool year, the purpose, objectives, and activities cf the 
elementary oounaelor will need to be reviewed and possibly 
modified. 
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COLUMBUS PUBLiC SCHOOLS - Columbus, Ohio PUPIL CENSUS FORM 



LAST NAME 



FIRST NAME 



M. I. 



•EX 



TEACHER NUMEIR 



25 



SCHOOL M n flBADE 

USE A NUMBER 2 PENCIL. ERASE COMPLETELY WHEN MAKING CORRECTIONS. 



3 



1. WAS THIS A NON-ENGLISH SPEAKING STUDENT? (SEE MEMO). 

YES NO 

oooooooooooooooo oooooooo oo ooooooooooo. 

2, * INDIVIDUAL COUNSELING CONTACTS WITH THIS PUPIL? I 



NONE 1-5 6-10 11-15 16 OR MORE 

ooooooooooooooooooooooQoooooooooooooo . 

3. * SMALL GROUP SESSIONS WITH THIS PUPIL? l 



NONE 1-5 6-10 11-15 16 OR MORE 

poo oooooooooooooooooooooooooooooooooo 

It. H CLASS ROOM GROUP SESSIONS mTH THIS PUpTl? I 



NONE 1-5 6-10 11-15 16 OR MORE 

0000600600600000000000000000000000000 . 



5. U FAMILY COUNSELING SESSIONS WITH THIS PUPIL? 



NONE 1-5 6-10 11-15 16 OR MORE 

OQQQQOQOOOOQOOOOOOQOQOQOQOOOQQQQQQQQQ. 

6_._ * TO TA L SESS I ONS WITH TH IS PUPIL? I 



NONE 1-5 6-10 11-1 5 16 0-! MORE 

o boQOOQOOOOOOOOOOOOQQQQQQQQQ QQQQQQOOO i 

' DID YOU REFER THIS PUPIL TO A SOCIAL AGENCY? | 



YES 



NO 



a 



O 



IS) 

U 



ooo o o o oooooo ooo oooooooooooooooooooooo, 

||8, IF~YTS TO'QUESTION 7, DID THE PUPIL- RECEIVE SERVICES? J 

YES NO 

. o ooooooo o o oQOooooooooo'ooooooooooooooo , 

[9TdTd YOU WOrF¥ItH~THIS PUPIL AT LEAST ONCE EVERY TWO WEEKS J 
INDIVIDUALLY OR IN A SMALL GnoUP ? YES NO 

oooooooooo ooooooooo oooooooooooooooooQ 

10. DlT~YOU WORK WITH THIS PUPIL AT LEAST ONCE EVERY TWO WEEKS J 

IN A CLASSROOM SETTING ? YES NO 



J OOOOOOOOO 0 0 ooo o oooooooooo ooo ooo oo^oo 

1 1 1 1 1 1 1 1 1 1 1 1 1 1*1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 ■ I ■ " ■ ■ i 



Counselor Name . School. 



DPPF Elementary Counseling Project 



COUNSELOR ACTIVITY LOO 
1983-84 



I. Please complete the following log, based on the amount of time devoted to 
such aotlvities during the assigned gfisk. 



Activity: 


Average Number of 
Sessions/Contacts 
Per Week: 


Avanacra Number 
of Students 
Pan Session: 


Average Number 
of Minutes 

Par Saasioni 


Individualized Coun- 

sallnj Siaalona , , 






Small Group Counseling 
and Instruction 






Large Group Guidance 






■ 

Job Development and Career 

Education Instruction 






Parent Conferences 

fin school) — 






Teacher/ Staff Conferences 






Home/Visits 






Referrals to Community 

Asenoies . 






Follow«ups of Referrals 

to Coaaunitv Aaeneies __ 






Referrals to Sohool 
Special Services Staff 

( Psvehologi^ta. mtn.) 






Follow-ups to Special 
Stiff 






Other: 







XX. Please estimate the total number of students in your building(a) needing 
counseling services, but who arw not being served. 



III. Indicate on the reverse side any exemplary school programs, aotlvities, 
etc. with whloh you are involved as an elementary counselor. 

er|c 24 85 10 



GENERAL INSERVICE EVALUATION FORM 



Inservlce Topic: 
Presented s) : 



Oate: 
Session: 



a.m. 



Fund: 

(circle only one) 



(e.g., 7/15/79) 

or p.m. 

(1) ESEA (2) DPPF 
(4) Other (Specify) 



(3) General 



Program: 

(circle only one) 



(1) ADK (2) Aides (3) BMIP (4) CLEAR-Elem (K-5) 
(5) CLEAR-M1ddle (6) El em. Couns. (7) HSCA 
(8) OND (9) PREK (10) SDR (11) Regular Teacher 
(12) Other (Specify) 



Circle the number that Indicates the extent to which you agree with statements 1-4. 



1. I think this was a very worthwhile 
meeting. 

2. The Information presented 1n this 
meeting will assist me 1n my 
program. 

3. There was time to ask questions 
pertaining to the presentation. 

4. Questions were answered 
adequately. 



Strongly Strongly 
Disagree Disagree Undecided Agree Agree 



1 



1 



2 
2 
2 



3 
3 
3 



4 
4 
4 



5 
5 
5 



5. What was the most valuable part of this meeting? 



6. What was the least valuable part of this meeting? 



7. What additional Information or topics would you like to see covered 1n future 
meetings? 
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APPENDIX B 



DPPP Elementary Counseling Piojeot 

SUMMARY 
COUNSELOR ACTIVITY LOO 
1983-84 



AotiTity: 


Umber of 
Seaaiona/Contaota 
Per Week: 


of Students 
Per Sessions 


of Minutes 
Per Seaalons 


IndlTiduallstd Coun- 

t*l 4 fit a jH tin a 


251 


1.0 


• 

10.6 


Saall Group Counatliog 

t«il Tmf utiAf 4 All 


AS 


5.6 


20.6 


Large Croup Guldanoe 


7fe 


27.1 


11.8 


Job DeYolopmnt and Carter 

am Tviaf WHAf 4 am 


c 


5.7 


6.8 


Parent Conferences 

(4f% fflAtlAOl ^ 

1 ■■ ■■Hllll A 


5Q 


' \ 




Teaoher/Staf f Conferenoea 


it* 


Hoae/Tlaita 


17 


Referrals to Coaaunlty 
Aaenolaa 


20 


Follov-upa of Referrals 

to Comunlty Agenolea 


29 


Referral* to Sohool 
Special SerTloea Staff 
fPBYQholMiata. eto.) 


55 


Pollov-upa to Speoial 

auff j 




Other: 
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